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[57] ABSTRACT 

A system and method of displaying movement in three- 
dimensional space in response to input from a conventional 
two-dimensional pointing device such as a mouse or track- 
ball. The three-dimensional space is projected onto a two- 
dimensional plane for display in a window on a display 
screen. A viewpoint position, which may be the center of the 
window, is defined as the current virtual position of the 
"camera 5 ' through which the three-dimensional space is 
viewed. The user manipulates an on-screen cursor across the 
window to specify a direction of movement in the two- 
dimensional plane. A three-dimensional direction of move- 
ment is derived from the user's input by defining a sphere 
having a center corresponding to a the center of the two- 
dimensional plane, and determining the intersection of a line 
perpendicular to the plane at the cursor location with the 
surface of the sphere. The direction of movement is then 
defined as a vector from the origin to the determined 
intersection. The system and method distinguish between 
navigation commands and object manipulation commands 
according to the timing and context of the commands. 
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SYSTEM AND METHOD FOR USING A 
POINTING DEVICE TO INDICATE 
MOVEMENT THROUGH THREE- 
DIMENSIONAL SPACE 

CROSS-REFERENCE TO RELATED 
APPLICATION 

This application is related to U.S. patent application Ser. 
No. 08/744,611 for "Method, Apparatus and Computer 
Program Products to Simulate the Display of Objects in 
Three Dimensions", by Ramanathan V. Guha, filed Nov. 6, 
1996, the disclosure of which is incorporated herein by 
reference. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates generally to navigation in a 
virtual three-dimensional space, and more particularly to a 
system and method for indicating and displaying movement 
through three-dimensional space. 

2. Description of Background Art 

Many computer software applications simulate movement 
through a virtual three-dimensional environment, or space. 
The three-dimensional space typically contains a plurality of 
objects, each having particular visual characteristics and a 
defined position in three-dimensional space. A two- 
dimensional projection of the three-dimensional space is 
displayed in a window on a display screen, including pro- 
jections of all or some of the objects. 

The techniques for projecting three-dimensional space 
onto a two-dimensional display window are generally 
known in the art. See, for example, J. Foley et al., Computer 
Graphics: Principles and Practice, 2 d. ed., Addison- 
Wesley, 1990. Typically, a viewpoint position and orienta- 
tion are established within the three-dimensional space, 
specifying the position and orientation of a virtual "camera" 
through which the user views the environment. Objects 
within a viewable area of the three-dimensional space are 
projected onto the display window by scaling objects 
according to their distance from the viewpoint position, so 
that more distant objects are shown smaller than closer ones. 
Other techniques may also be used to represent relative 
detail, such as changes in color, level of detail, and the like. 

Many such conventional systems provide mechanisms by 
which a user may change the viewpoint position. By suc- 
cessively redrawing objects according to changed viewpoint 
positions, the system can simulate movement through the 
three-dimensional space. 

In order to effectively provide such simulated three- 
dimensional movement, the system must be capable of 
accepting input from a user specifying desired directions and 
speeds of movement. Conventional, commonly-used input 
devices are typically capable of indicating movement on a 
computer display in only two dimensions. More complex 
pointing devices such as virtual reality gloves are available 
but tend to be more expensive than commonly-available 
devices such as mice or trackballs. 

In many systems, direct manipulation of on-screen objects 
is performed by positioning a cursor under the control of an 
input device such as a mouse or trackball and clicking a 
button. If the same input device is employed for both 
manipulation and navigation, ambiguity may result when the 
user clicks the button. In other words, it may not be clear 
whether the user wishes to manipulate an on-screen object or 
to move in the direction pointed. Modifier keys or multiple 
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mouse buttons may be employed, but these techniques 
introduce complexity, increase learning time and confusion, 
and detract from the intuitive nature of the interface. 
What is needed is a system and method for a user to 

5 indicate movement in three -dimensional space in an intui- 
tive manner using a conventional, commonly available input 
device such as a mouse or joystick. In addition, what is 
needed is a system and method for distinguishing between 
navigation and manipulation commands in a manner that 

io does not significantly increase the complexity of the system 
from the user's point of view. 

SUMMARY OF THE INVENTION 

The present invention provides a system and method of 

15 displaying movement in three-dimensional space in 
response to input from a conventional two-dimensional 
pointing device such as a mouse or trackball. 

The three-dimensional space is projected onto a two- 
dimensional plane for display in a window on a display 

20 screen. A viewpoint position, which may be the center of the 
window, is defined as the current virtual position of the 
"camera" through which the three-dimensional space is 
viewed. Three axes may thus be defined: a horizontal x-axis 
and a vertical y-axis, both parallel to the display window, 

25 and a z-axis representing movement perpendicular to the 
display window. The viewpoint position is located at the 
origin of the axes. 
The user manipulates an on-screen cursor across the 

3Q window to specify a direction of movement in the x- and y- 
axes. Keyboard keys or mouse buttons are pressed to specify 
"forward" or "backward" movement (corresponding to the 
positive or negative direction of the z-axis). 

A direction of movement is derived from the user's input 

35 as follows. A sphere is defined having a center correspond- 
ing to the origin of the axes and thus corresponding to the 
viewpoint position. A line is defined which is perpendicular 
to the display window and which intersects the plane of the 
window at the coordinates specified by the position of the 

4Q on-screen cursor. If the cursor position lies within the radius 
of the circle defined by the sphere's projection in the display 
window, the line will intersect the surface of the sphere at 
two points, one representing movement into the screen 
(corresponding to "forward" movement) and one represent- 

45 ing movement out of the screen (corresponding to "back- 
ward" movement). One of the two points is selected based 
on the user's keyboard or mouse button input. The direction 
of movement is then defined as a vector from the origin to 
the selected point on the sphere. 

50 If the cursor position lies at the edge of the circle defined 
by the sphere's projection, or outside the bounds of the 
circle, the direction of movement is defined as a vector from 
the origin to the x- and y-coordinates of the cursor position, 
with a z-component of zero. This represents movement 

55 along the plane of projection. 

The display is then adjusted to reflect movement in the 
direction of the defined vector by changing the coordinates 
of the viewpoint position and generating a new two- 
dimensional projection. In accordance with user input, the 

60 speed of movement may be changed by scaling the vector by 
a specified factor. The cursor may be moved as the display 
is adjusted, resulting in corresponding adjustment of the 
movement vector using the technique described above. 
If a non-linear projection technique is employed, as 

65 described in related U.S. patent application Ser. No. 08/744, 
611 for "Method, Apparatus and Computer Program Prod- 
ucts to Simulate the Display of Objects in Three 
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Dimensions", the viewpoint position is adjusted to compen- 
sate for the non-linearity and to preserve the illusion of 
movement in the desired direction. 

In addition, the three-dimensional navigation scheme of 
the present invention may be employed in an application 
wherein the user is able to manipulate objects within the 
three-dimensional environment. For example, the user may 
wish to move or activate buttons or icons within the window. 
Such manipulation is often performed using the same input 
device, such as a mouse or trackball, and the same keys or 
.buttons, as is used for navigation. In order to preserve a 
simple and intuitive user interface, one embodiment of the 
present invention provides a mechanism for distinguishing 
among the user's desired actions based on the context and 
nature of the user input. For example, if the user clicks a 
mouse button on an area of the screen and holds down the 
button for some period of time (such as for example 0.5 
seconds) without substantially moving the cursor, this is 
interpreted as a navigation command. However, if the user 
clicks the mouse button and immediately starts moving, this 
is interpreted as an object manipulation command specifying 
movement of the object under the cursor (if any). If no object 
is under the cursor, this command is interpreted as naviga- 
tion. Thus, the intended action is determined based on the 
context of the user's input. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. lAis a block diagram of a hardware architecture for 
practicing the present invention. 

FIG. IB is an example of a screen shot showing a window 
containing a two-dimensional projection of a three- 
dimensional space. 

FIG. 2 is a front view of a window containing a two- 
dimensional projection of a three-dimensional space. 

FIG. 3 is a side view of a window containing a two- 
dimensional projection of a three-dimensional space. 

FIG. 4 is a front view of a window containing a two- 
dimensional projection of a three-dimensional space, after 
the viewpoint position has moved. 

FIG. 5 is a flowchart of a method of indicating and 
displaying movement through three-dimensional space 
according to the present invention. 

FIG. 6 is a flowchart of a method of determining a 
movement vector according to the present invention. 

FIG. 7 is a flowchart of a method of correcting viewpoint 
position for nonlinear movement according to the present 
invention. 

FIG. 8 is a block diagram of objects displayed in three 
planes according to one embodiment of the present inven- 
tion. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Referring now to FIG. 1A, there is shown a block diagram 
of a hardware configuration for practicing the present inven- 
tion. In one embodiment, the present invention is imple- 
mented as software running on a conventional personal 
computer such as an Apple® Macintosh® computer. Thus, 
the hardware architecture of system 120 as shown in FIG. 
1 A may be implemented as a combination of components of 
such a computer, though other implementations may also be 
used. Central processing unit (CPU) 121 executes software 
instructions and interacts with other components to perform 
the techniques of the present invention. Random-access 
memory (RAM) 122 stores software instructions to be 



U.440 

4 

executed by CPU 121, and may store other data to act as a 
workspace in the implementation of the present invention, 
including for example, representations of object character- 
istics and positions in three-dimensional space. Disk drive 

S 123 provides long- term storage of data and software pro- 
grams. Input devices such as mouse 125 and keyboard 126 
facilitate user control of the operation of system 120, includ- 
ing navigation through a simulated three-dimensional envi- 
ronment. Display screen 127 is an output device such as a 

10 cathode-ray tube for the display of two-dimensional projec- 
tions of the three-dimensional space under the control of 
CPU 121. System 120 may also include communications 
device 124 such as, for example, a modem for connection to 
a computer network such as the Internet. 

15 Referring now to FIG. IB, there is shown a sample screen 
shot of a window 100 containing a two-dimensional projec- 
tion 103 of a three-dimensional space. In one embodiment, 
window 100 is displayed on display screen 127. Objects 102 
are located at various positions in the three-dimensional 

20 space and are projected onto window 100 using techniques 
that are known in the art. In the example shown, the 
impression of depth is created by overlaying closer objects 
102 on top of objects 102 that are farther away. In addition, 
closer objects 102 are displayed at a larger size than objects 

25 102 that are farther away. Finally, the example of FIG. IB 
differentiates among several distance planes by the use of 
distinct colors. Other visual cues representing relative dis- 
tance may also be used. In one embodiment, the projection 
is performed using adjusted spread between objects 102 as 

30 described in related application Ser. No. 08/744,611. Margin 
frame 101 provides a navigational tool for moving parallel 
to the plane of the projection, as will be described in more 
detail below. 

In one embodiment, objects 102 represent documents and 
35 directories that may be manipulated, opened, or activated by 
the user. In one embodiment, system 120 is connected to a 
network such as the Internet, and some objects 102 may 
represent web pages or other documents accessible by 
system 120 over the network via communications device 
40 124. 

The present invention is directed towards a system and 
method of navigating through a three-dimensional space as 
exemplified in FIG. IB. 

45 Referring now to FIG. 5, there is shown a flowchart of a 
method of indicating and displaying movement through 
three-dimensional space according to the present invention. 
An initial viewpoint position is established. Based on this 
viewpoint position, system 120 generates and displays 501 

50 an initial two-dimensional projection of a three-dimensional 
space in a window 100 on display screen 127. 

In one embodiment, such display is generated by conven- 
tional projection methods. In another embodiment, the two- 
dimensional projection is generated in a nonlinear manner, 

55 as described in related U.S. patent application Ser. No. 
08/744,611. Related U.S. patent application Ser. No. 08/744, 
611 describes a hierarchical arrangement of data, with each 
object being assigned a level in the hierarchy. An object is 
related to one or more objects on the level beneath it by 

60 being a parent of such lower level objects, with each of the 
lower level objects having a common parent being siblings 
to one another. A two-dimensional projection of a three- 
dimensional space allows the user to view hierarchically 
arranged data by displaying objects at each level in a 

65 separate plane, with each plane being positioned at a dif- 
ferent distance (z-value) from the user. The relationships 
among sibling objects and between child and parent objects 
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may be graphically represented by clustering the child 
objects around the projection of their parent on the plan 
directly behind the plane containing the parent. However, as 
the plane containing the child objects approaches the 
window, it is desirable to ensure adequate space between the 
objects to allow the user to maneuver among the objects and 
to allow room to display the descendants of the child objects 
in an uncluttered way. Thus, the related patent application 
describes a technique of adjusting the spacing between 
objects differently from the size of the objects as the user 
navigates in three-dimensional space. In effect, as the user 
navigates closer to a set of objects, the objects appear to 
spread apart from one another more quickly than they are 
growing in size. As objects approach, the spread between 
two objects, representing the distance between their 
projections, is determined using the prior spread, the 
increase in size of the objects, and a scaling factor or scaling 
factor function. 



One example of a scaling factor function is: 



K n 
1 m-l 



where: 

K is a constant; 

Mhe distance between the projection window and the 
first visible plane; 

n-the number of planes between the projection window 
and the plane of the object in question; 

b^-^l+the number of sibling objects of the object or its 
ancestor in the mth displayed plane. 

Referring now to FIG. 8, there is shown a sample two- 
dimensional projection of a hierarchical arrangement of 
objects in three-dimensional space. Objects 410, 420, 422, 
424, 426, 430, 432, 434, 436, 438, 440, 442, 444, 446, 448, 
450, and 452 are displayed on three planes. Objects 420, 
422, 424, 426, all displayed on plane 2, are arranged in a 
circle 411 having a radius 409 around their parent object 
410, displayed on plane 1. Child objects 430, 432, 434, all 
displayed on plane 3, are arranged in a circle 421 having a 
spread equal to radius 419 around their parent object 420. 
Other objects 436, 438, 440, 442, 444, 446, 448, 450, 452, 
all displayed on plane 3, are arranged in circles 425, 429, 
433 having radii 423, 427, 431 around parent objects 422, 
424, 426, as shown in the Figure. The spread between each 
of the child objects 420, 422, 424, 426, 430, 432, 434, 436, 
438, 440, 442, 444, 446, 448, 450, 452 and its parent is equal 
to the radius of the circle 411, 421, 425, 427, 429 on which 
the object is displayed. 

Thus, for circle 425, b 2 =l (1+0 sibling objects of object 
410), b 2 =4 (1+3 sibling objects of object 422), and b 3 =4 
(1+3 sibling objects for each object 436, 438, 440, 442). The 
scaling factor given by Eq. 1 will thus be (K/l )xVixVixV£, or 
(K/l)xVi, or O.250C/1). By contrast, the scaling factor for 
circle 429 is 0.35(K/1 ). The displayed radius of each circle 
is divided by the scaling factor, so that circles on which more 
objects are placed grow larger than circles on which fewer 
objects are placed. 

The position of a given object in the two-dimensional 
projection is determined by reference to the position of its 
parent object using the equations: 



10 
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(Eq. 1) 
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55 



60 



m=2 



(Eq2) 
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where: 

x p n>fjre*<t> > 'projected represent the projected coordinates of 
the object in window 100; 

x i> Yi arc tne x an d y coordinates of the highest-level 
visible ancestor of the object; 

x « y« are tne x ancl y coordinates of the viewpoint 
position; 

f( ) is the scaling function, for example as described in Eq. 

1; 

n is the number of planes between the projection plane 
and the plane containing the object, plus 1; and 

x^, y m are the x and y coordinates of the ancestor of the 
object on plane m, relative to the x and y coordinates of the 
ancestor's immediate parent. 

Referring now also to FIG. 2, there is shown a front view 
of a simplified representation of a window 100 containing a 
two-dimensional projection 103 of a three-dimensional 
space as displayed 501 by system 120. In one embodiment 
of the present invention, the three-dimensional space can be 
described in terms of a coordinate system including x- and 
y-axes as shown, along with a z-axis (not shown) which 
extends in a direction perpendicular to the plane of window 
100. All three axes have an origin 204 which corresponds to 
the center of window 100. In one embodiment, origin 204 is 
also the viewpoint for the two-dimensional projection. Other 
coordinate schemes and orientations may be used, including, 
for example, placing the viewpoint at some non-zero posi- 
tion along the z-axis. In one embodiment, such as that 
illustrated in FIG. 1, the location of origin 204 is not 
displayed on the screen. 

Referring again to FIG. 5, system 120 accepts 502 user 
input from mouse 125 or keyboard 126 specifying a cursor 
position in window 100. Cursor 201 is a movable pointer 
that is controlled by the user. In one embodiment, the user 
manipulates a pointing device such as mouse 125 or track- 
ball (not shown) to control the position of cursor 201 within 
window 100, although other mechanisms such as a keyboard 
126 may be used. The user selects a desired direction for 
movement by positioning cursor 201. The user then initiates 
movement by providing a movement command 503. In one 
embodiment, such movement command is provided by 
clicking and holding down a mouse button. Alternatively, 
such movement command may be provided via keyboard 
126. Point 202 in FIG. 2 indicates the position of cursor 201 
at the moment the user initiates movement. 

In one embodiment, the user may further, specify the 
direction and speed of desired movement via modifier keys, 
such as the following: 

Forward movement ("into" the screen): hold mouse but- 
ton down 

Backward movement ("out of the screen): hold Com- 
mand or Control key on keyboard 126 while holding mouse 
button down, or hold second mouse button down 

Accelerated movement: hold Shift key while performing 
other commands 

Highly accelerated movement: hold Control or Alt key 
while performing other commands 

Once the movement command has been provided by the 
user, the system of the present invention determines 504 a 
movement vector representing a direction of movement in 
three-dimensional space. The movement vector is a three- 
dimensional vector specifying a direction and magnitude of 
movement. 

Referring now to FIG. 6, there is shown a flowchart of a 
method of determining 504 a movement vector according to 
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one embodiment of the present invention. Referring also to motion "into" the screen. System 120 defines 608 movement 

FIG. 3, there is shown a side view of the simplified projec- vector 304 using the coordinates of intersection 302. This 

tion shown in FIG. 2, with additional constructions illus- movement vector 304 is then modified and applied as 

trating the method of FIG. 6. As described previously, the described above in connection with FIG. 5. 

three-dimensional movement vector is determined based on s i n another embodiment, system 120 determines 504 a 

the two-dimensional position of cursor 201. If cursor 201 is movement vector as (x, y, z), where x and y are the 

within margin frame 101 at the time the movement com- coordinates of cursor 201 in window 100, and z is an 

maud is initiated, the movement vector is assigned 602 a albit z . value , hat b(J a predctennined co^,,,, or 

z-va hie of zero, so that the v.ewpoint position will move be ^.configurable, or may be some linear or nonlin- 

parallel to the plane of the projection. Thus, the user can M eaf of x and z be multi Ued b _j t0 Micile 

specify horizontal, vertical, or diagonal movement in the x-y movement .. out of . ^ 

Plane if desired by positioning cursor 201 in the appropriate Re{elting again t0 nG . 5( system no modifies 505 the 

location in within margin frame 101 movement vector according to the modifier keys activated 

If cursor 201 us not within margin frame 101, system 120 b me ^ if i pi0 liale For e k y; acce i erated 

constructs 603 a sphere 203 Jn one embodiment, sphere 203 u movement is indicated tem 120 multiplies the terms of 

is not delayed on screen 127 but is used for determination me movement vector 5 some constant in order t0 increase 

of the movement vector as follows. In one embodiment, maemmc j e 

sphere 203 has a center corresponding to the center of s m , hen 50g ^ vi in , ^ 204 

window 100 and a diameter such that the edge of sphere 203 ^ me direction and itude ified b lhe movement 

touches each of the four inside borders of margin frame 101. 20 vec , or ,„ 0Qe embodiment this ^ accomplished by addirjg 

If wmdow 100 is not square a spheroid may be used in place (he terffls of ^ movcment vector t0 me coordinates of th t 

of sphere 203. In an alternative embodiment, sphere 203 is vitwpoit)l md tne result t0 the viewp oint. 

constructed having some other size and/or center point ^ d6Scribed ab in 0Qe embodiment of mc nl 

Referring agajn to FIG. 2, the projection of sphere 203 mvenlioil) the two-dimensional projection is generated using 

onto wmdowlOO forms a aide. If cursor 201 is not within 2J , ^ factof ^ a scaU factQr ^ ^ non]inelr 

the circle defined by the projection of sphere 203, foe jection results aad thus it ^ advantageous t0 adjust , he 

movement vector s assigned 602 8 2^0^26^0, so that vi int ition , Q ^ the iIlusion of three . 

the viewpoint position will move parallel to the plane of the dime[lsional movement , he desire d direction. Specifically, 

P ro J e <; tlon - „„„ „ , , . 0 -„-. . ... when the user is moving in the direction of a particular 

Referring again to FIGS. 3 and 6 if cursor 201 is within 30 objec , m k is desirab , e that , he a , ;Uon of me 

thec.rcle, ^system 12( constructs 605 a hne 301 penpendicu. objec , 1Q2 fa (he lw<wUmen8ional projection remains 

lar to window 100 and passing through the point 202 defined statio or in an altcrnative erabo diment, changes in a 

by the location of cursor 201. System 120 then determines , An( ,ji a j „„„„„ K „ n u: a „ t m-) »™„*„i ,1° 

A c - A - - n - i v - ni ..... - controlled manner by moving object 102 toward the center 

606 the intersections 302, 303 of line 301 with the surface r t . „„„ 

. ' , . „„„ or the screen, 

of sphere 203. In general, two such intersections^ 303 3S Refcrrin now to FIG 7 tnere ^ shown a flowchar , of a 

will exist, one on each side of the x-y plane. The three- m6thod of adjus(in me vi im ition t0 ^ , he 

dimensional coordinates of these intersections can be rep- ■,,„,.•„ rtfj . Mn i „^ „ * • *u a • a a- 

r illusion or three-dimensional movement in the desired direc- 

resen e as. ^ on s vstem ^20 identifies 701 which node, or on-screen 

m . object 102, is closest to the center of window 100. In an 

(A*, Ay, Ar) - (*„ m N 2rm-m 2 ) < * > 40 alternative embodiment, system 120 identifies a node that is 

closest to the cursor position. This "center node" is desig- 

and nated as N c . System 120 then determines 702 the x and y 

coordinates of the center node in the two-dimensional pro- 

(A*, Ay, A*) - (jw>>w*, - N trm - m* ) jection of window 100. These are designated as N^, N Cy . 

45 The viewpoint position in three-dimensional space before 

ere: application of the movement vector is designated as (x u , y M , 

X d 00 yCM "° r coordinate5 of cursor 201 m z„). The movement vector is designated as (Ax, Ay, Az). 

window 100, Thus, if linear projection is used, viewpoint position is 

r is the radius of sphere 203; and . . _ , updated 506 by adding the movement vector to the view- 

m is the distance between viewpoint position 204 and 50 int positioil) OT that: 
cursor 201, such that 

Xunn-Xvokft&c; (Eq. 6) 

y^.^y uo ^y; (Eq. 7) 

55 ^«-^o//+Az (Eq. 8) 

System 120 then selects 607 one of the two intersections. t , . 

If the z-axis points "out" of the display screen, the intersec- ,f nonlinear projecuon is used, x aMW and y_ are then 

tion 303 having a positive z- value represents backwards a JUS ^ 0 ows * 

movement "out" of the screen, while the intersection 302 (Eq. 9) 

having a negative z-value represents forward movement 60 

"into" the screen. Thus, the selection of one of the two y^dfym^^y; (Eq. 10) 

intersections is made based on the user's input regarding where fl afe such tha| N N do ^ cn 

forward or backward movement. As described above in one SQ ^ me ent ition of ^ c£ £ er ^ Qn ^ ^ 

embodiment backward movement is indicated by holding a „ • m „. 

. , , , . 7 to remains constant, 

command or conuol key on keyboard 126. 65 SystelI1 120 determines 3x by setting 

In the example of FIG. 3, intersection 302 is selected, 

representing a negative z-value corresponding to forward (Eq. 11) 
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and solving for ax. Thus, applying Eqs. 2 and 3, 



Ncsvld - (*l - *«)A*jbrr(l) + 



and 



i=2 



£ 2 xj a/lrf (m). 
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(Eq. 12) 



(Eq-13) 
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i fl ^ er =distance to plane of object 410 after movement* 
100-50-50; 
x^x-position of object 410=0; 
x^x-position of object 422=10; 
x 3 =x-position of object 440=20; 
x H =x-position of viewpoint=20; 
bi-l+number of siblings of object 410-1+0-1; 
b 2 =l+number of siblings of object 422=1+3=4; 
b 3 -l+number of siblings of object 440-1+3-4. 
Thus, 



. (,.*),.,.N7(,Ht)(-^ ^.-^ ^ ^) 

- -10-(l,5)(5 + 5) 
« -25. 



Setting these equal to each other, we obtain: Therefore, in order to preserve the illusion of movement 

toward object 440 by maintaining its position in the two- 
, v m 5 , , x (Eq. H) 20 dimensional projection, the viewpoint position is moved 

C*. -*J&*«U) + w ^ 2 Wm-W - ^ 0Qg mc x . axis by _ 25 . Assuming no adjustment is made 

along the y-axis, the final position for the viewpoint is 

<»-*.-VU#)+ l*u*> ( - 2 °- 25 t > °.> 50 >> °. r ^{A 5 ?- ft A . , <n , . . 

m=2 Referring again to FIG. 5, after adjusting 506 viewpoint 

25 position, system 120 displays 507 a new two-dimensional 

ax can then be obtained by solving Eq. 14, so that: projection based on the adjusted viewpoint position 204. 

Referring now also to FIG. 4, there is shown an updated 

n n fEa 15) ^ ront v * cw °^ w ^ nc * ow 100 given the starting viewpoint 

(*i-x«)/*;brr(i)+ 2 Xnfbcfinim)- S xj afiet {m) q ' position of FIG. 2 and some degree of movement in the 

d x - *i - x, m ° 2 x j , — direction indicated by cursor 201 . 

'"■^ ) Referring again to FIG. 5, the user may indicate that 

If the scaling function of Eq. 1 is employed, we obtain: continued or additional movement is desired by holding 



(Eq. 16) 



m«2 " I W«" p-\ \J b p J m=2 " I U<r p=\ \ h? J 



which reduces to: 

50 

A similar technique is employed for determining 3y, so 
that: 

V /m-2 lp-l\Tfc^ I 

For example, in FIG. 8, if object 410 is located at (0, 0, 60 
100); the viewpoint is located at (20, 0, 0); object 422 is 
located at (10, 0, 140); object 440 is located at (20, 0, 180); 
and the user moves the viewpoint forward to (20, 0, 50); the 
following values apply. 

N c , the center node, is object 440; 65 
l^^distance to plane of object 410 before movement= 
100-0=100; 



down the mouse button. If additional movement is indicated 
508 after the new projection is displayed, system 120 returns 
to 502 to obtain a new cursor 201 position. If desired, the 
user may move cursor 201 to another location in window 
100, in which case the movement vector will be modified 
accordingly. 

In some applications, system 120 may provide function- 
ality allowing the user to activate and/or move some or all 
of on-screen objects 120. It then becomes useful to distin- 
guish between user actions specifying viewpoint movement 
and user actions specifying manipulation or activation of 
on-screen objects 120. In one embodiment wherein mouse 
125 has more than one button, different mouse buttons may 
be used to represent different actions. For example, a first 
mouse button may be used to specify viewpoint movement, 
while a second mouse button may be clicked to activate an 
object 120 or held down while dragging mouse 125 to move 
an object 120. In another embodiment, the two functions 
may be specified by holding down modifier keys on key- 
board 126. 

In another embodiment, all such functions are imple- 
mented using a single mouse button. The desired operation 
is determined based on the context and nature of the user's 
action. Thus, if the user positions cursor 201 over an object 
120 and clicks the mouse button briefly, object 120 is opened 
or activated, depending on the nature of object 120. If the 
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user positions cursor 201 over an object 120, clicks and 
holds the mouse button, and immediately starts dragging 
cursor 201 to another position, object 120 is moved accord- 
ingly. If the user clicks and holds the mouse button for some 
period of time without substantially changing the position of 5 
cursor 201, system 120 interprets the command as a navi- 
gation command and moves viewpoint position 204 to 
simulate movement through the three-dimensional space. 
Thus, when the mouse button is pressed, system 120 waits 
some interval of time before commencing movement, in 10 
order to determine whether the user intends to drag an 
on-screen object 102 or move the viewpoint position 204. In 
one embodiment, this time interval is 0.5 seconds, though 
other time intervals may be used, and user configuration of 
the time interval may be permitted. In one embodiment, 15 
some small amount of cursor 201 movement is permitted 
without activating object 120 movement, and user configu- 
ration of this "tolerance" amount may be permitted as well. 

In one embodiment, if the user clicks the mouse button 
while cursor 201 is not positioned over any object 102, 20 
viewpoint position movement commences immediately, 
since there is no ambiguity as to the intended action. 

The above description provides merely exemplary 
embodiments for practicing the present invention. Those 
skilled in the art will recognize that other embodiments are 25 
possible without departing from the spirit or essential ele- 
ments of the invention claimed herein. 

What is claimed is: 

1. A method for displaying movement through a virtual 
three-dimensional space, comprising: 30 

a) determining a viewpoint position in the three- 
dimensional space; 

b) displaying a two-dimensional projection of the three- 
dimensional space onto a plane, based on the viewpoint 
position; 

c) identifying a point on the plane; 

d) identifying a destination position in the three- 
dimensional space based on the identified point on the 

P lane ; 40 

e) moving the viewpoint position in the direction of the 
destination position; and 

f) displaying a two-dimensional projection of the three- 
dimensional space based on the moved viewpoint posi- 
tion. 45 

2. The method of claim 1, wherein c) comprises deter- 
mining a position of an on-screen cursor. 

3. The method of claim 1, wherein d) comprises: 

d.l) defining a sphere having a center corresponding to 
the viewpoint position; and so 

d.2) determining a point on the sphere being the intersec- 
tion of a line perpendicular to the plane and intersecting 
the identified point on the plane. 

4. The method of claim 1, wherein the identified point has 

an x-coordinate and a y-coordinate, and wherein d) com- 55 
prises identifying a destination position having three- 
dimensio nal coord inates selected from one of ( x c „„ or , 

ycurson ^2rm-m 2 ) and (x curson y curso „ -^2rm-m 2 ), where 
^cursor represents the x-coordinate of the identified point and 6Q 
y cursor represents the y-coordinate of the identified point. 

5. The method of claim 1, further comprising: 

b. l) defining a z-axis perpendicular to the plane having a 
positive direction and a negative direction; and 

c. l) identifying one of the positive and negative z-axis 65 
directions for movement; 

and wherein d) comprises: 



35 



d.l) defining a sphere having a center corresponding to 
the viewpoint position; and 

d.2) determining a point on the sphere being the inter- 
section of a line parallel to the z-axis, originating at 
the identified point on the plane, and constructed in 
the z-axis direction identified in c.l). 

6. The method of claim 5, wherein c.l) comprises deter- 
mining a position of a key on a keyboard. 

7. The method of claim 1, wherein the viewpoint position 
has an x-coordinate and a y-coordinate, and wherein d) 
comprises identifying a destination position having x- and 
y-coordinates corresponding to the x- and y-coordinates of 
the viewpoint position, and having a z-coordinate corre- 
sponding to a predetermined value. 

8. The method of claim 1, wherein the viewpoint position 
has an x-coordinate and a y-coordinate, and wherein d) 
comprises identifying a destination position having x- and 
y-coordinates corresponding to the x- and y-coordinates of 
the viewpoint position, and having a z-coordinate derived by 
applying a function to the values of the x- and y-coordinates. 

9. The method of claim 1, wherein b) comprises display- 
ing the two-dimensional projection in a window having a 
frame and a center, the frame comprising at least two 
opposing sides, each opposing side comprising a midpoint, 
the frame representing at least a portion of the plane, and 
wherein d) comprises: 

d.l) defining a sphere having a center corresponding to 
the center of the window and a point of tangency with 
each midpoint of two opposite sides of the frame; and 

d. 2) determining a point on the sphere being the intersec- 
tion of a line perpendicular to the plane and intersecting 
the identified point on the plane. 

10. The method of claim 1, further comprising: 
c.l) specifying a movement speed; 

and wherein: 

a) comprises determining a viewpoint position in the 
three-dimensional space, the viewpoint position 
defined by an x-coordinate, a y-coordinate, and a 
z-coordinate; 

d) comprises identifying a destination position defined 
by an x-coordinate, a y-coordinate, and a 
z-coordinate; and 

e) comprises adjusting the x-coordinate, y-coordinate, 
and z-coordinate of the viewpoint position by a 
specified amount based on the specified movement 
speed, to move the viewpoint position in the direc- 
tion of the destination position. 

U. The method of claim 10, wherein c.l) comprises 
determining a position of a switch. 

12. The method of claim 10, wherein b) comprises dis- 
playing a linear two-dimensional projection. 

13. The method of claim 10, wherein b) comprises dis- 
playing a nonlinear two-dimensional projection. 

14. The method of claim 13, wherein the three- 
dimensional space contains at least one object, the object 
having an initial position in the two-dimensional projection, 
the method further comprising: 

e. l) designating one of the at least one objects; and 
e.2) further adjusting the coordinates of the viewpoint 

position to maintain the initial position of the object in 
the two-dimensional projection. 

15. The method of claim 1, further comprising: 

c.l) detecting an input signal specifying a movement 
command. 

16. The method of claim 15, wherein c.l) comprises 
detecting that a button is pressed. 
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17. The method of claim 15, wherein c.l) comprises 
detecting that a button is held for a predetermined length of 
time. 

18. The method of claim 15, wherein: 

c) comprises detecting a position of an on-screen cursor 

controlled by a mouse having a button; 
c.l) comprises detecting that the mouse button is held for 

a predetermined length of time while the on-screen 

cursor remains substantially stationary. 

19. The method of claim 18, wherein the predetermined 
length of time is sufficiently long to distinguish the move- 
ment command from an object manipulation command. 

20. The method of claim 1, wherein the three-dimensional 
space contains at least one object, at least one of the objects 
representing a document. 

21. A computer program product comprising a computer- 
usable medium having computer-readable code embodied 
therein for displaying movement through a virtual three- 
dimensional space, comprising: 

computer-readable program code devices configured to 
cause a computer to determine a viewpoint position in 
the three-dimensional space; 

computer-readable program code devices configured to 
cause a computer to display a two-dimensional projec- 
tion of the three-dimensional space onto a plane, based 
on the viewpoint position; 

computer-readable program code devices configured to 
cause a computer to identify a point on the plane; 

computer-readable program code devices configured to 
cause a computer to identify a destination position in 
the three-dimensional space based on the identified 
point on the plane; 

computer- re ad able program code devices configured to 
cause a computer to move the viewpoint position in the 
direction of the destination position; and 

computer- readable program code devices configured to 
cause a computer to display a two-dimensional projec- 
tion of the three-dimensional space based on the moved 
viewpoint position. 

22. The computer program product of claim 21, wherein 
the computer-readable program code devices configured to 
cause a computer to identify a destination position comprise: 

computer-readable program code devices configured to 
cause a computer to define a sphere having a center 
corresponding to the viewpoint position; and 

computer-readable program code devices configured to 
cause a computer to determine a point on the sphere 
being the intersection of a line perpendicular to the 
plane and intersecting the identified point on the plane. 

23. The computer program product of claim 21, wherein 
the viewpoint position has an x-coordinate and a 
y-coordinate, and wherein the computer-readable program 
code devices configured to cause a computer to identify a 
destination position comprise computer-readable program 
code devices configured to cause a computer to identify a 
destination position having x- and y-coordinates corre- 
sponding to the x- and y-coordinates of the viewpoint 
position, and having a z-coordinate derived by applying a 
function to the values of the x- and y-coordinates. 

24. The computer program product of claim 21, further 
comprising: 

computer- readable program code devices configured to 

cause a computer to specify a movement speed; 
and wherein: 

the computer-readable program code devices config- 
ured to cause a computer to determine a viewpoint 
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position comprise computer-readable program code 
devices configured to cause a computer to determine 
a viewpoint position in the three-dimensional space, 
the viewpoint position defined by an x-coordinate, a 
y-coordinate, and a z-coordinate; 
the computer-readable program code devices config- 
ured to cause a computer to identify a destination 
position in the three-dimensional space comprise 
computer-readable program code devices configured 
to cause a computer to identify a destination position 
defined by an x-coordinate, a y-coordinate, and a 
z-coordinate; and 
the computer-readable program code devices config- 
ured to cause a computer to move the viewpoint 
position in the direction of the destination position 
comprise computer-readable program code devices 
configured to cause a computer to adjust the 
x-coordinate, y-coordinate, and z-coordinate of the 
viewpoint position by a specified amount based on 
the specified movement speed, to move the view- 
point position in the direction of the destination 
position. 

25. The computer program product of claim 24, wherein 
the three-dimensional space contains at least one object, the 
25 object having an initial position in the two-dimensional 
projection, and wherein the computer-readable program 
code devices configured to cause a computer to display a 
two-dimensional projection of the three-dimensional space 
onto a plane comprise computer-readable program code 
30 devices configured to cause a computer to display a nonlin- 
ear two-dimensional projection, the computer program prod- 
uct further comprising; 

computer-readable program code devices configured to 
cause a computer to designate one of the at least one 
35 objects; and 

computer-readable program code devices configured to 
cause a computer to further adjust the coordinates of 
the viewpoint position to maintain the initial position of 
the object in the two-dimensional projection. 
40 26. The computer program product of claim 21, wherein 
the computer-readable program code devices configured to 
cause a computer to identify a point on the plane comprise 
computer-readable program code devices configured to 
cause a computer to detect a position of an on-screen cursor 
45 controlled by a mouse having a button, the computer pro- 
gram product further comprising: 

computer-readable program code devices configured to 
cause a computer to detect that a button is pressed and 
held for a predetermined length of time while the 
on-screen cursor remains substantially stationary, to 
specify a movement command, the predetermined 
length of time being sufficiently long to distinguish the 
movement command from an object manipulation 
command. 

27. An apparatus for displaying movement through a 
virtual three-dimensional space, comprising: 

a memory module for storing a viewpoint position in the 
three-dimensional space; 
60 a display device, coupled to the memory module, for 
displaying a two-dimensional projection of the three- 
dimensional space onto a plane, based on the viewpoint 
position; 

an input device, coupled to the memory module, for 
65 identifying a point on the plane; 

a destination position identifier, coupled to the memory 
module, for identifying a destination position in the 
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three-dimensional space based on the identified point 
on the plane; and 

a viewpoint position mover, coupled to the memory 
module for moving the viewpoint position in the direc- 
tion of the destination position; 

wherein the display device further displays a two- 
dimensional projection of the three-dimensional space 
based on the moved viewpoint position. 

28. The apparatus of claim 27, wherein the destination 
position identifier defines a sphere having a center corre- 
sponding to the viewpoint position and determines a point 
on the sphere being the intersection of a line perpendicular 
to the plane and intersecting the identified point on the plane. 

29. The apparatus of claim 27, wherein the viewpoint 
position has an x-co ordinate and a y-coordinate, and 
wherein the destination position identifier identifies a des- 
tination position having x- and y-coordinates corresponding 
to the x- and y-coordinates of the viewpoint position, and 
having a z-coordinate derived by applying a function to the 
values of the x- and y-coordinates. 

30. The apparatus of claim 27, wherein: 

the input device further specifies a movement speed; 
the stored viewpoint position is defined by an 

x-coordinate, a y-coordinate, and a z-coordinate; 
the identified destination position is defined by an 

x-coordinate, a y-coordinate, and a z-coordinate; and 
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the viewpoint position mover adjusts the x-coordinate, 
y-coordinate, and z-coordinate of the viewpoint posi- 
tion by a specified amount based on the specified 
movement speed, to move the viewpoint position in the 
s direction of the destination position. 

31. The apparatus of claim 30, wherein: 

the three-dimensional space contains at least one object, 
the object having an initial position in the two- 
10 dimensional projection; 

the display device displays a nonlinear two-dimensional 

projection; and 
the viewpoint position mover designates one of the at 
least one objects and further adjusts the coordinates of 
15 the viewpoint position to maintain the initial position of 
the object in the two-dimensional projection. 

32. The apparatus of claim 27, wherein the input device 
comprises a mouse having a button for controlling an 
on-screen cursor, and wherein the input device detects that 

20 the button is pressed and held for a predetermined length of 
time while the on-screen cursor remains substantially 
stationary, to specify a movement command, the predeter- 
mined length of time being sufficiently long to distinguish 
the movement command from an object manipulation com- 

25 mand. 
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